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which  is  composed  of  two  distinct  production  processes,  types  A and  B, 
that  produce  two  different  products , I and  H,  having  independent  non- 
negative random  demands . Production  type  A produces  both  products  re- 
lated by  a fixed  set  of  production  coefficients.  Type  B can  only  be 
used  to  produce  product  II.  Each  period,  the  optimal  production  level 
of  each  type  must  be  determined.  The  criterion  is  the  minimum  expected 
discounted  total  cost.  Results  show  that  the  decision  space  is  parti- 
tioned into  four  distinct  regions,  whose  boundaries  are  characterized 
in  terms  of  a particular  sequence  of  points  which  are  independent  of 


the  on-hand  stock  levels. 


Introduction 


Although  the  theory  of  single  product  inventories  initiated  by  [1,  2 ] 
and  [ 3 ] is  extensive,  the  same  is  not  true  for  multiproduct  inventories. 

The  numerous  papers  that  have  appeared  constitute  a fraction  of  the  myriad 
of  possibilities  that  arise  in  complex  real  inventor;'-  systems.  Ctae possi- 
bility not  yet  considered  corresponds  to  the  problem  of  coordinating  dif- 
ferent types  of  production  processes  used  to  manufacture  several  stock  items, 

_ 

when  the  demands  are  stochastic*  This  paper  considers  an  inventory-produc- 

] 

tion  system  such  as  the  one  depicted  in  Figure  1,  having  a by-product  pro- 
cess and  a single  item  process  that  together  product  two  products.  Such  a 
system  occurs  naturally  (although  often  in  much  more  complicated  forms ) in 
such  settings  as  steel  mills,  tire  manufacturing  plants,  chemical  manufact- 
uring plants,  etc..  For  specificity,  it  is  assumed  that  the  two  production 
processes  are  labelled  as  types  A and  B while  the  stock  items  are  called 
products  1 and  2.  It  is  assumed  that  type  B is  designed  to  produce  only 
product  2 and  is  called  a single  item  process.  Type  A is  assumed  to  be  a 
generalized  by-product  process;  a unit  of  production  yields  Vj  ( >0 ) of 
product  j,  j=l,  2.  It  is  not  required  that  T)^  + » 1.  The  parameters 

T] . are  called  production  coefficients  and  they  are  fixed  characteristics 

J 

of  type  A and  cannot  be  changed.  In  this  context,  type  B is  the  alterna- 
tive method  of  producing  product  2.  The  system  is  of  the  periodic  review 
type;  i.e.,  at  the  beginning  of  each  period  (over  a finite  horizon)  the 
stock  levels  are  reviewed  and  the  production  levels  of  types  A and  B are 
determined. 


In  reviewing  the  literature  one  sees  that  a variety  of  papers  have 
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been  written  concerning  the  control  of  inventories  for  several  products. 

The  excellent  survey  paper  written  by  Veinott  [l£]  reviews  the  literature 
through  I965.  Among  the  topics  discussed  by  him  we:  substitute  products, 

multilocation  systems,  ordering  and  repair  and  capital  accumulation  and 
production.  Veinott  [15]  developed  a very  general  multiproduct  model  that 
allowed  for  several  demand  categories.  Evans  [6  ] considered  the  control  of 
a by-product  production  system  using  two  different  production  cost  struc- 
tures: under  lost  sales  he  used  a linear  joint  production  cost  and  under 

complete  backlogging  he  was  able  to  generalize  K-convexity  to  allow  for 
a fixed  set  up  cost.  Evans  [5  ] considered  a raultiproduct  system  when 

of  substitutability  between  products.  Johnson  [10]  presented  an  infinite 
horizon  model  with  fixed  set  up  costs  for  an  inventory  system  consisting 
of  several  different  products.  Silver  [14]  and  Goyal  [8,  9]  considered 
the  problem  of  joint  replenishment  when  demands  are  known.  Most  of  these 
papers  dealt  with  multiproduct  inventories  when  the  stock  items  are  re- 
lated in  some  fashion  (resource  limitations,  by-products,  etc.).  Appar- 
ently, the  problem  of  coordinating  production  processes  has  not  yet  been 
considered,  within  the  context  of  inventory  theory. 

The  intent  of  this  paper  is  to  develop  a dynamic  model  of  the  system 
described  by  Figure  1 so  optimal  production-inventory  policies  can  be  de- 
rived for  controlling  the  system  over  any  finite  planning  horizon.  In 
the  next  section  the  necessary  assumptions  are  stated  and  the  appropriate 
notation  is  developed  so  that  a precise  mathematical  statement  of  the 
model  can  be  made.  Section  3 contains  the  central  result  of  the  paper 
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along  with  other  technically  oriented  results.  The  proofs  of  many  of  the 
results  are  found  in  the  Appendix. 


2.  Notation,  Assumptions,  and  Madel  Formulation 

The  following  definitions,  assumptions,  and  conventions  serve  to  state 
the  model  mathematically. 

a)  In  discussing  the  model,  n will  he  the  period  index,  with  periods 
numbered  backwards  and  with  N the  horizon. 

b)  y and  z denote  arbitrary  production  levels  for  types  A and  B, 
while  x and  w denote  the  stock  levels  at  the  beginning  of  a period  (prior 
to  production  and  demand). 

c)  The  demands  for  products  1 and  2 in  period  n,  and  respec- 

tively, are  independent  nonnegative  random  variables  with  continuous  den- 
sities 5 = 1>2.  Furthermore,  the  demands  Dn  * (D^,  D^)  are  inde- 

pendent and  identically  distributed. 

d)  If  cp  is  a differentiable  scalar  function,  the  convention  cp'(t)  » 

is  used.  If  cp:Hn  is  twice  differentiable,  we  use 
<P(i)(t)  = rr“  ¥(t)  i - 1,2 

«d  1,3  - 1,2. 

e)  It  is  assumed  that  a level  of  y ^ 0 costs  cy  for  type  A implying 
that  all  costs  are  aggregated  into  this  linear  function,  where  c ^ 0.  A 
level  of  z costs  kz  for  type  B,  where  k > 0.  Although  it  is  somewhat  re- 


strictive  to  omit  setup  costs,  there  are  a variety  of  systems  such  as  pe- 
troleum cracking  plants  where  changing  from  one  production  process  to  another 
is  inexpensive.  However,  more  general  cost  structures  are  to  be  considered 
in  a later  article. 

f)  The  function  L(a,b)  represents  the  joint  expected  holding  and 
shortage  cost  given  a and  b of  products  1 and  2,  respectively,  on  hand 
after  production  and  prior  to  demand.  It  is  assumed  that  L is  strictly  con- 
vex and  is  continuously  differentiable.  In  addition,  we  assume 

(i)  L(a,b)  - + « 

(ii)  Tlj^Cc  - T^k]  a + kb  + L(a,b)  - + ® 

whenever.  |a|  -*  + » and  |b|  -•  + ®.  The  quantity  T^k  - c represents  the 
difference  in  cost  resulting  from  producing  product  2 via  type  B rather  than 
A.  If  this  cost  is  positive,  then  it  is  not  difficult  to  show  that  pro- 
duct 1 is  too  expensive  and  will  be  produced  only  when  type  B is  not  used. 

We  assume  l^k  - c is  negative  (i.e.,  c - Pgk  > 0).  The  cost  ^[c  - Tlgk] 
represents  the  marginal  cost  of  producing  product  1. 

g)  The  discount  cost  is  denoted  by  or  and  it  is  assumed  that  0^  or^  1. 

The  joint  cost  c in  (e)  is  similar  to  the  one  used  by  Evans  [6  ],  and 
is  a convenient  means  of  expressing  the  costs  of  operating  type  A.  The 
linear  cost  k for  type  B is  analogous  to  the  linear  cost  used  by  Arrow, 
Karlin  and  Scarf  [3  ].  The  function  L defined  in  (f)  is  by  now  standard 
in  inventory  theory,  and  the  strict  convexity  is  not  too  restrictive.  The 
remainder  of  assumption  (f)  is  used  to  establish  the  finiteness  of  the  op- 
tinal  policy  in  period  1 (n-l)  and  is  analogous  to  the  standard  p'(0)  > c 
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assumption  found  in  the  literature. 

The  appropriate  dynamic  functional  equation  in  period  n is 


Cn(x,w)  = inf  3n(y,z,x,w) 

y £ 0 

z > 0 


where 


Bn(y,z,x,w)  - cy  + kz  + L^y+x,  z + T^y  + w)  + 


SD  W 


Cn-1(\y+X  “ tf  z + 1hy  + v -u)f1(t)f2(u)dtdu 


= cy  + kz  + Jn(\y  + x,  z + T^y  + w) 


where 


J (x,w)  a L(x,w)  + o 'If  C -(x-t,  w-u)f  (t)fp(u)dt  du,  for  n = 1,2,...N. 
^ n-i.  X C. 


J simply  represents  the  expected  value  part  of  B and  is  used  for  concise 
n n 

notation.  The  initial  condition  CQ(x,w)  = 0 implies  that  J (x,w)  = L(x,w) 
for  n = 1.  Bn(y,z,x,w)  is  the  total  expected  discounted  cost  starting  with 
(x,w)  and  following  policy  (y,z)  while  Cn(x,w)  is  the  optimal  return  function, 
ftrom  period  n to  the  horizon.  The  result  of  this  stagewise  optimization 
problem  is  to  characterize  the  optimal  production  policy 

(y*(x,v),  z*(x,w))  - £(y?(x,w),  z*(x,w))l?  . 

*+  **  ii  n -*■ 

One  minor  departure  from  standard  inventory  analysis  made  for  notation- 
al  convenience  is  that  the  production  levels  are  used  directly  in  this  model 
rather  than  the  target  stock  levels. 

The  central  result  of  this  article  is  that  the  decision  space  and  opti- 
mal policy  are  characterized  in  terms  of  a point  (xn>wn)  monotone  func- 


w) 
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Figure  2 

Characterization  of  Decision  Plane  for  1. 
(x,  w)  is  initial  position,  arrowhead 
marks  resultant  after  ordering. 
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tions  r (x),  q_(x)  and  w (x)  in  each  period  n as  depicted  in  Figure  2.  The 
n ii  J n 

tail  of  each  arrow  represents  the  initial  stock  (x,w)  while  the  head  of  each 
arrow  indicates  the  optimal  target  levels  in  each  period  n.  Notice  there 
are  four  decision  regions,  I - IV,  corresponding  to  using  both  A and  B,  using 
only  A,  using  only  B,  and  not  producing  at  all,  respectively. 

The  next  section  constitutes  the  complete  analysis  of  the  model  set 
forth  in  this  section,  and  the  proof  of  the  results  depicted  in  Figure  2. 


3.  Results 

The  following  theorem  sets  forth  many  of  the  properties  of  Bq  and  also 
proves  the  existence,  finiteness  and  uniqueness  of  the  optimal  policy.  In 
addition,  some  properties  of  the  optimal  return  function,  Cq  are  also  stated. 
Theorem  1 

B (y,z,x,w)  is  strictly  convex  in  (y,z,x,w)  and  is  continuously  differen- 
n 

tiable.  In  addition,  for  each  bounded  (x,w),  the  following  also  hold: 

(1)  All  level  sets  of  the  form 

^(C)  31  t(y>z);  Bn(y,z,x,w)<  ci 

are  compact  for  any  C?CO,®)  and  fixed  (x,w). 

(2)  The  optimal  policy  (y*(x,w),  z*(x,v))  is  finite  and  unique.  In 
addition,  the  unique  unconstrained  global  minimum  (ynU(x,w),  znU(x,w))  solves 
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where  Bn(y,z,x,w)  reaches  its  minimum  first  when  y=0  and  then  when  z=*0  have 
unique  finite  solutions  yn(x,w)  and  zn(x,w),  respectively. 

(It)  Cn(x,w)  is  convex  and  continuous. 

Since  the  optimal  policy  is  constrained  to  be  nonnegative,  one  can  see 
there  are  four  possibilities:  y£(x,w)  > 0,  z*(x,w)  >0;  y£(x,w)  >0, 

z*(x,w)  » 0;  y£(x,w)  * 0,  z*(x,w)  > 0;  and  y£(x,w)  » z*(x,v)  * 0.  The  next 
theorem  demonstrates  that  all  four  combinations  can  indeed  occur,  and  spe- 
cifies the  conditions  used  to  define  the  optimal  policy  in  each  case. 

Theorem  2 

The  optimal  policy  is  characterized  by  the  following  four  regions. 

(a)  Region  I (Both  A and  B are  used): 

y*(x,w)  > 0 and  z*(x,w)  > 0 

can  occur  iff  (x,w)  satisfies 

y^(x,w)  >0  and  z^(x,w)  > 0 ; 

3n  which  case  (y*(x,w),  z*(x,w))  » (y^(x,w),  z^(x,w)). 

(b)  Region  II  (Only  A is  used): 

y£(x,w)  > 0 and  z*(x,w)  » 0 

can  occur  iff  (x,w)  satisfies 

y^(x,w)  > 0,  yn(x,w)  > 0 and  z^(x,w)  .<  0; 

In  which  case  (y£(x,w),  z*(x,w))  - (yn(x,w),  0). 


• (c)  Region  III  (Only  B is  used): 
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y£(x  jw)  = 0 and  z*(x,w)  > 0 

can  occur  iff  (x,w)  satisfies 

y^(x,w)  ^0  and  z^(x,w)  > 0 , zn(x,w)  > 0; 

in  which  case  (y*(x,w),  z*(x,w))  = (0,  z^(x,w)). 

(d)  Region  IV  (No  production): 

y£(x,w)  = 0 and  z*(x,w)  * 0 

can  occur  iff  (x,w)  satisfies  one  of  the  following: 

(i)  (yJJ(x,w),  z^(x,w))  ^ 0 ; 

(ii)  y^(x>w)  > 0,  z^(x,w)  ^ 0 but  yn(x,w)  < 0 ; 

(iii)  y^(x,w)  ^ 0,  z^(x,w)  >0  but  zn(x,w)  ^ 0. 

Notice  that  all  of  the  events  involving  (x,w)  in  (a)  - (d)  are  mutually 
exclusive  and  exhaustive. 

The  next  theorem  presents  some  of  the  properties  of  the  optimal  policy 
as  (x,w)  varies. 


Theorem  3 

1.  Bn(y,z,x,w)  is  continuously  twice  differentiable.  In  addition,  the 
optimal  policy  is  piecewise  differentiable.  Furthermore,  the  partial  de- 
rivatives of  the  optimal  policy  satisfies  the  following  relations: 


(a)  In  region  I: 

y*(1)(x,w)  = -t^"1 

Zn^(X’w)  = 


y£^(x,w)  = 0 
z*^(x,w)  - -1. 
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(b)  In  region  IT: 

-1  < V£U)(x,w)  < 0 

z*y\x,v)  « 0 j-1,2. 

(c)  In  region  III: 

y£(j)(x,v)  = 0 j-1,2. 

z*(l)(x,w)  > 0 and  z*^2\x,w)  = -1. 

(d)  In  region  IV: 

y*^(x,v)  = 0 
z£(j)(x,v)  = 0,  j-1,2. 

2.  Cn^(x,v)  has  piecewise  continuous  derivatives  for  j=l,2. 

Furthermore, 

7b.Cn^J,1^(X,W)  + T12Cn^’2^x»w)  ^°>  J=1»2 

and 

Cn^,2\x,w)  » Cn^2,^^(x,w)  ^ 0. 

Theorem  3 shows  that  the  partial  derivatives  of  the  optimal  policy  are 
piecewise  continuous,  with  the  points  of  discontinuity  occurring  on  the 
boundaries  between  regions.  Part  (a)  indicates  that  in  region  I,  y*(x,w) 
is  linear  and  decreasing  in  x.  In  the  same  region,  z*(x,w)  is  linear  by  de- 
creasing in  both  x and  w.  These  properties  are  exploited  in  the  main  result, 
Theorem  4.  The  results  in  parts  (b),  (c),  and  (d)  are  intuitive,  except  for 
the  unexpected  property  that  z*(x,w)  is  nondecreasing  in  x in  region  III  (part 
(c)). 
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As  mentioned  above,  the  linearities  in  region  I are  the  key  to  the 
Theorem  U.  The  following  points  and  functions  sure  needed  for  the  Theorem 
and  some  of  their  properties  are  given  in  Lemma  3- 
Let  the  point  (x  , w ) solve 

Bn(j)(0,0,Jn,wn)  = 0 j-1,2. 

Furthermore,  define  functions  rn(x),  q^(x),  and  w^(x)  pointwise  in  the  fol- 
lowing manner: 

Bn^(0,0,x,rn(x))  = 0,  x^x^ 

3n^(0,0,x,qn(x))  = 0,  x >xn 

and 

wn(*)  4 ;n  - 

Then,  the  following  lemma  can  be  stated. 

Lemma  3. 

(1)  (x  , w ) is  finite  and  unique. 

n n 

(2)  r (x)  that  solves 

n 

Bn^(°,0,x,rn(x))  = °»  X-Sxn 
is  finite  and  unique. 

(3)  %(*)  solving 

Bn^(0,0,x,qn(x)) 2  3 0,  x *xn 
is  unique  and  finite. 

(h)  w^ (x ) 3 Mn  " r2\  1[xn  - x]  is  well  defined. 
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(5)  (a)  rn’(x)<0,  x < *n 

and  r (x  ) * w . 

n'  n'  n 

Cb)  0 < q^'fr)  < 1,  x > xn 

S,(in)  - \ 

(c)  »n'0O  * i^V"1 

and  w (x)  = w . 
n n 

The  characterization  of  the  ordering  regions  can  now  be  stated  in  Theorem 

k. 

Theorem  U 

The  optimal  policy  and  the  four  decision  regions  are  uniquely  char- 
acterized as  follows. 

(a)  Region  I (Both  A and  B are  used): 

If  x < x and  w < w (x),  then 
n n 

y*(x,w)  = Tl1"1[xn  - x]  (>  0) 

z*(x,w)  - wnM  “ w (>0),  and  conversely. 

(b)  Region  II  (Only  A is  used): 

If  x<xn  and  vn(x)  ^ w < rR(x) , then 

y£(x,w)  > 0 and  z*(x,v)  - 0 

and 

rn(x  + Tljy^Xjv))  - w + R2y^(x,w),  and  conversely. 
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(c)  Region  HI  (Only  B is  used): 

If  x ^xn  and  w < q^(x),  then 

y*(x,w)  = 0 

and 

z*(x,w)  = (^(x)  " w (>  0)»  and  conversely. 


(d)  Region  IV  (No  production): 

(y*(x,w),  z*(x,w))  * 0 

iff  either 

x < xn  and  w ^r  (x) 
or 

x > xfi  , and  w ^^(x). 


Proof:  The  proof  is  by  induction  on  the  period  index  n.  To  establish  the 

initial  case,  n=l,  one  njakes  use  of  the  special  simple  structure  of  re- 
sulting from  the  initial  conditions  along  with  assumption  (f).  The  steps 
of  this  proof  are  exactly  the  same  as  those  used  to  prove  the  general  in- 
duction step.  To  conserve  space,  we  provide  only  the  proof  of  the  general 
inductive  step.  Thus,  it  is  assumed  the  theorem  is  true  for  periods  1,2,*»*, 
n-1  and  show  it  true  for  period  n. 

First,  make  the  following  definitions: 

¥„U(x,v)  • xn  - X 
znU(x,w)  = wn(x)  - W. 

The  proof  of  this  theorem  amounts  to  showing  that  the  above  definitions 
are  valid  and  then  showing  that  the  conditions  for  each  region  as  set  forth 
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in  Theorem  2 are  met  as  stated  in  the  proposition. 

The  defining  conditions  for  (ynU,  *nU)  and  (*n>  ^n)  and  the  strict  con- 
vexity of  B assert  the  validity  of  the  definitions  above, 
n 

(a)  If  x < x and  w < w (x),  then  (y*,  z*)  >0  as  a consequence  of 

n n n n ~ 

Theorem  2.  On  the  contrary,  y£  > 0 tallies  that  x < x^,  which  along  with 

z*  > 0 implies  that  w < w (x)  as  desired, 
n n 

(b)  If  x < xn  and  wn(x)  < w,  it  follows  that  yRU  > 0,  ^ 0, 

Then,  w < rn(x)  implies  that  B ^ (0,0,x,w)  < 0 which  along  with  the  strict 

convexity  of  B implies  that  y >0.  Hence,  y*  > 0,  z*  ■ 0 as  a consequence 

n n n n 

of  Theorem  2.  On  the  contrary,  y * > 0 and  z*  » 0 imply  that  ynU  > 0,  yR  > 0, 

znu  ^ 0 via  Theorem  2.  Now,  > 0 implies  that  x < xn  which  together  with 
z u < 0 implies  that  w > w (x).  x < x and  y >0  together  with  the  strict 
convexity  of  Bn  imply  that  B ^ (0,0, x,w)  < 0 or  simply  w <rn(x).  Finally, 
let  x°  = x + . Then 

0 + ^Jn(l)(x°,  rn(x°))  + TfeJn(2)(x°,  rn(x°))  = 0. 

But,  it  also  follows  that 


c + Vn^Vn  + x’  Vn  +w^  + ^Jn(2)(7h.y?  + x>  Vn  + * °* 

Therefore,  the  conclusion  is  that  + w « rn(x°). 


(c)  If  x > x^  and  w < q^x),  then  ynU  ^ °»  and  *n  > 0 "by  "the  strict 
convexity  of  Bq.  Theorem  2 is  then  applied  to  assert  that  y£  * 0 and  z*  > 0. 
On  the  contrary,  yRU  ^ 0 and  > 0 together  imply  that  x > xn  and 
w < q^(x)  by  the  strict  convexity  of  B . Finally,  it  must  be  the  case  that 

(2\x,  z + w)  =»  0 
n 


k + J 
n 


..  . 


r 
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and  that 

k + Jn(2)(x,  q^x))  - 0. 
Therefore,  it  follows  that  q (x)  * z + w. 


Q.E.D. 


The  reader  is  once  again  referred  to  Figure  2 as  a visual  help  to 
understanding  Theorem  4.  Although  Theorem  2 proves  that  there  are  four  de- 
cision regions,  it  is  this  theorem  that  provides  the  insight  into  the  model 
and  the  behavior  of  the  optimal  policy.  Specifically,  once  the  functions 
rn ( ' ) > wn(* ) and  the  points  (xn,  vn)  have  been  generated  with 

regard  to  one  dimensional  optimization,  the  following  scheme  should  be  fol- 
lowed in  order  to  implement  the  policy  in  each  period: 

STEP  1 (Region  I) : 

If  x > x go  to  step  3.  If  not,  then  check  to  see  if  w >w  (x).  If 
n ' n 

so,  go  to  step  2.  Otherwise,  both  A and  B are  to  be  used  at  optimal  levels 

y*(x,w)  = Ik _1[x  - x]  and  z*(x,w)  = w (x)  - w. 
n x n n n 

Go  to  step  4. 

STEP  2 (Region  H) : Set  z*(x,w)  = 0. 

If  w >rn(x),  do  not  produce  at  all  this  period.  In  this  case,  go  to 
step  4.  Otherwise,  only  type  A is  used  with  y^  solving 

v + TkJT*(x,w)  » rn(x  + ^(x.w)). 

Now,  go  to  step  4. 


STEP  3 (Region  III):  Set  y*(x,w)  = 0. 

If  w >qn(x),  do  not  produce  at  all  this  period.  In  this  case,  go  to 


t 
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step  4.  Otherwise,  type  B will  be  used  at  level  z*(x,w)  ■ q^x)  - w. 
Now,  go  to  step  4, 

STEP  4 

If  n < N,  set  n - n + 1 go  to  step  1.  Otherwise  stop. 


This  article  has  presented  a new  class  of  multiproduct  inventory  sys- 
tems, where  decisions  must  be  made  at  regular  intervals  of  time  (periods) 
concerning  the  optimal  stock  levels  to  maintain  in  order  to  anticipate 
stochastic  demands.  The  novel  feature  of  this  new  class  is  the  notion  of 
coordinating  different  types  of  production  processes,  operated  in  parallel 
(and  independently),  that  are  used  to  supply  the  stock  items  to  the  inven- 
tory system.  Theoretical  results  were  presented  that  characterized  the 
optimal  production  policy  in  each  period,  in  terms  of  functions  rn(x),  ^(x^ 
and  vn(x) , and  a point  (xn,  wn).  Various  properties  of  these  functions 

were  also  delineated,  and  it  was  shown  that  (x,  w ) is  not  necessarily  the 

n n 

global  minimum  of  the  expected  cost  function.  An  implementation  scheme  was 
stated  that  provides  guidelines  for  using  the  above  results.  The  model  ex- 
plicitly assumed  stationary  demands  and  complete  backlogging.  The  exten- 

* 

sion  to  nonstationary  demands  is  quite  straight  forward,  and  is  accomplished 
by  adding  superscripts  to  the  densities,  f^(*)>  J™1>2  in  all  of  the  lemmas 
and  theorems  and  also  in  Theorem  4. 

The  lost  sales  case  can  also  be  handled,  in  fact  the  form  of  the  opti- 


mal policy  remains  the  same.  However,  Theorem  2 must  be  proven  in  a slight- 
ly different  manner.  The  details  are  described  in  Deuermeyer  [4  ]. 


A 
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APPENDIX 

This  appendix  contains  the  proofs  of  the  theorems  and  lemmas  needed 
to  establish  Theorem  4 stated  in  Section  3.  The  following  well  known 
result  (see  Rockefeller  [12])  is  used  to  prove  Theorem  1. 

Lemma  4:  Let  C(x)  * min  B(x,y)  = B(x,y*(x)) 

y£>(x) 

where  y*(x)QD(x)  and  x€A.  Assume  C and  B are  real  valued.  Then,  if  A is 
a convex  set,  B is  jointly  convex  and  if  X ■ {(x,y);  y®(x)l  is  convex, 
then  C(x)  is  convex  in  x. 

Proof  of  Theorem  1:  The  proof  is  by  induction  on  n.  First,  consider  n=l. 

The  differentiability  and  strict  convexity  of  are  inherited  from  L. 

(2)  Let  £^(C)  * {(y,z);  B^yjZjX,*)  ^ £l 

where  £ is  finite.  Since  Bx  in  continuous  it  follows  that  £^(£)  is  closed 
for  each  £.  It  suffices  to  show  that  l1  (c°)  is  bounded  for  some  arbitrary 
£°,  since  Rockafeller  [12]  has  shown  that  if  any  level  set  of  a closed  con- 
vex function  is  bounded  then  they  all  are.  Suppose  ^^(C0)  18  n°t  bounded. 

Then,  3(y°,  z°)  and  an  unbounded  sequence  { (y ^ 811011 

lim  B-Jy.  + y°,  z.  + z°,  x,w)  ^ £°. 

However,  this  statement  contradicts  Assumption  f.  Thus,  £^,(6°)  *8  coin“ 
pact.  The  existence  parts  of  (3)  and  (5)  follow  using  the  convexity  and 
the  conpactness  of  £^(£)  with  £ » B^(0,0,x,w)  and  the  Weierstrass  theorem. 

The  rest  of  (3)  and  (5)  are  merely  statements  of  the  first  order  conditions 

. - jA 
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for  differentiable  convex  functions.  Lemma  4 can  be  applied  to  prove  (4) 

because  is  convex  and  the  optimal  policy  is  finite. 

To  complete  the  inductive  argument  it  is  assumed  the  theorem  is  true 

for  n-1  and  show  it  is  true  for  period  n.  Fhrt  (1)  is  a consequence  of 

the  inductive  hypothesis  and  the  strict  convexity  of  L.  To  prove  (2)  the 

continuity  of  B is  used  to  assert  the  closedness  of  each  level  set 
n 

4(0  * C(y»*);  Bn(y,z,x,w)^  O 

for  every  £€  [0,  » ).  It  remains  to  show  that  for  any  fixed  finite  £°€[0,  ® ) 
that  £^(6°)  is  bounded.  Suppose  not;  then  3(y0,  z°)  and  an  unbounded  se- 
quence { (y^,  z^) such  that 

(1)  lim  Bn(yi  +y°,  z±  + z°,  x,w)  < £°. 

i-»® 

But,  since  Cn_^(x,w)  ^0  for  all  (x,w),  it  follows  that 

Bn(y,z,x,v)  ^.B^y^Xjw). 

It  then  follows  that  (l)  can  not  hold  because  B^  is  unbounded.  The  rest 
of  the  proof  repeats  the  same  steps  as  in  the  n»l  case,  by  simply  replac- 
ing 1 by  n. 


Proof  of  Theorem  2:  The  proof  is  by  induction  on  n,  the  period  index.  The 

proof  relies  on  the  Kuhn-Tucker  saddle-point  theory  for  convex  functions, 
and  relies  on  the  information  supplied  by  Theorem  1,  namely  the  strict  con- 
vexity of  B and  the  finiteness  of  the  optimal  policy.  Since  the  proof  of 
n 

the  n=l  case  is  exactly  the  same  as  the  general  inductive  step,  we  provide 
only  the  general  step.  By  substituting  1 for  n in  the  proof  to  follow  and  # 
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making  use  of  the  initial  conditions  previously  stated,  the  proof  of  the 
n-1  case  is  immediate.  Thus,  assume  the  theorem  is  true  for  periods  1,2,»**, 
n-1  and  we  now  show  it  is  true  for  period  n. 

For  an  unconstrained  problem  such  as  is  the  case  here  (except  for  the 
nonnegativity)  the  optimal  policy  must  solve  the  Kuhn-Tucker  saddle  point 
conditions  as  put  forth  in  Mangasarian  [11].  In  the  present  context,  it 
follows  that  (y£(x,w),  z*(x,w))  is  the  optimal  policy  iff  this  point  solves 

(Kl)  Bn^(y*(x,w),  z*(x,w),  x,w)  ^0 

(K2)  Bn^(y£(x,w),  z*(x,w),  x,v)  ^0 

(K3)  y*(x,w).  Bn^1^(y^(x,w),  z*(x,w),  x,w)  » 0 

0&)  z*(x,w).Bn^2\y*(x,w),  z*(x,w),  x,w)  » 0 

(K5)  (y^(x,w),  z*(x,w))  >0 

The  theorem  is  proved  as  outlined  below,  using  (Kl)  - (K5). 

(a)  If  (y£(x,w),  z*(x,w))  >0  , then  B^i^(y^(x,w),  z*(x,w),  x,  w)  * 0, 

i*l,2  by  (K3)  and  (K4).  In  this  case,  (y*(x,w),  z*(x,w))  solves  the  same 

n n 

system  that  uniquely  defines  (yU(x,w),  zu(x,w)),  so  these  points  are  iden- 

n n 

tical.  On  the  other  hand,  if  (yU(x,w)  zu(x,w))  > 0,  it  iB  easy  to  show  it 

n n 

solves  (Kl)  - (K5)  establishing  the  desired  equivalence. 

(b)  The  proofs  of  (b)  and  (c)  are  essentially  the  same  so  only  (b)  is 
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shown  here.  For  simplicity,  the  abbreviated  notation  y*  ■ y*(x,v), 

j n n 

z*  a z*(x,w),  etc,,  will  be  used.  Now,  y*  > 0 and  z*  * 0 imply  y u > 0 
n n * n 

and  zrU  ^ 0.  (Kl)  and  (K3)  imply  that 

B„^(y£,  0,  x,w)  * Bn^(y£>  z*,  x,w)  - 0 


n wn 


or  that  y*  * y so  y >0  as  well.  Hence,  y*  > 0,  z*  » 0 implies  y >0, 
n n n n n n 

y > 0,  and  z u ^ 0. 
n n 

To  prove  the  converse  note  that 

yRU  > 0 and  zqU  ^ 0 imply  ^0  and  z*  * 0. 


Therefore , 


Bn^(y£»  °>  x’v ) znf  x*  v^' 


Since  (y*,  0)  necessarily  solves  (Kl)  - (K5)>  it  must  solve  Bq'  '(y£,  0,  x, 
w)  ^0  and 

y£*Bn^(y£,  0,  x,  w)  ■ 0. 

But,  solves  Bn^^(y  , 0,  x,  w)  = 0 so  (y^,  0)  will  also  solve  (Kl)  - (K5). 
The  uniqueness  of  with  this  argument  asserts  that  y^  ■ y*  > 0.  There- 


fore, 


yU>0,  zu<:0  and  y >0  implies  y*  > 0 and  z*  » 0. 
n n ^ n n n 


(d)  The  validy  of  this  part  follows  directly  from  the  contrapositives  of 

parts  (a)  - (c).  For  example,  if  (i),  (ii),  or  (iii)  hold,  then  (y*,z*)  * 0^ 

by  the  contrapositive  of  (a),  (b)  or  (c),  respectively.  Conversely,  if 

(y*,z*)  = 0 , one  of  (i)  - (iii)  must  hold. 
n n ~ Q.E.D. 


Proof  of  Theorem  3 s The  n*l  case  that  initiates  the  inductive  argument  fol- 
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lows  In  similar  fashion  to  the  general  step  and  is  omitted  only  to  conserve 
space.  Assume  the  theorem  is  true  for  periods  1,2,***,  n-1;  it  is  to  be 
shown  true  for  period  n. 

(l)  is  a piecewise  differentiable  function  by  the  inductive  hypothe- 

sis applied  to  the  final  conclusion  for  j=l,2.  Therefore,  the  expected 

value  of  is  continuously  differentiable  by  the  continuity  of  f .(*)- 

n-i.  j 

From  this,  it  follows  that  Bn  has  continuous  second  partial  derivatives. 


(2)  Recall  that 

3n(y,z,x,w)  = cy  + kz  + J^T^y  + x,  z + l^y  + w). 
Therefore,  in  region  I,  y£  - y£(x,w)  and  z*  * z*(x,w)  solves 

c + Vn(l)(y£>  zn>  x,  w)  - i^k  = 0 

k + Jn^2\y*,  z*,  x,  w)  * 0. 


Since  B is  strictly  convex  the  Implicit  Function  Theorem  can  be  applied 
n 

to  assert  the  differentiability  of  the  optimal  policy  in  an  open  neighbor- 
hood of  (x,w)  in  the  interior  of  region  I;  moreover  the  partials  are 
given  by 


y*^(x,v)  = -t 


v* 
' n 


(2) 


(x,w) 


W8*1’ 

J t1’2' 

J <2-2> 

n 

n 

Vn(1’2) 

. r (1,2) 

Vn 

j <2.2> 

J c 2 

n 

n 

1 

A 


0 
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where 


1 

'A 


z*(2)(x,w) 


1 

T 


v'4M 


’ll  Jn 


(1.2) 


(1.2) 


vV1A) 


% Jn 


(1.2) 


W1’1’ 

Vn'2’21 

'„(2-2) 

Wn'2’15 

TVJ  (2>^ 

Vn 

W2*i0 

J (2’2> 
n 

WJn(1’S) 

V„<2’2) 

Jn(2’1,| 

-1 


3 -1 


and  Jn(i,d)  - Jn(i’^(VJ  + x*  z£  + ¥£  +w)’  i,)  * 1»2* 

The  remainder  of  the  proof  proceeds  in  much  the  same  fashion  using  the 
defining  identities  of  the  optimal  policy  in  each  of  the  remaining  regions. 
In  addition,  the  following  relations  must  be  verified: 

Jn(i,i)(x,w)  >0,  1*1,2 

Jn(1’2)(x,v)  - j/2,l)(x,v)  <0 

^Jn(j,l)(x,w)  + Vrn(J’2)(x’w)  >0’  J*1’2* 


(3)  The  finiteness  of  (y*,  z*)  implies  that 

Cn(x,w)  - cy*  + kz*  + Jn(T|jy*  + x,  z*  + Tfey£  + w). 

The  proof  of  this  part  is  very  straight  forward  and  amounts  to  differentiat- 
ing the  above  relation  for  (x,w)  in  each  of  the  individual  regions.  The 
remainder  of  the  proof  is  omitted. 


Q.E.D. 
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Proof  of  Lemma  3:  The  proof  is  by  induction  on  the  period  index.  The  n*l 

case  follows  exactly  the  same  proof  of. the  general  n step  making  use  of  the 
initial  conditions  previously  stated,  with  n set  to  1.  The  explicit  proof 
is  omitted  simply  to  conserve  space . It  is  assumed  the  lemma  is  true  for 
periods  1,2,* n-1  and  is  to  be  shown  valid  for  period  n.  Consider  the 
strictly  convex  function 

Q (x,w)  = B (0,0,x,w). 
n n 

(1)  By  definition,  (x^,  v^)  solves 

Qn^(xn,  vn)  * Bn^(0,0,x,w)  = 0,  i-1,2. 

which  is  finite  and  unique. 

(2)  The  strict  convexity  of  Q,^  arid  the  Implicit  Functic  Theorem  assert 
the  finiteness,  uniqueness,  and  differentiability  of  the  point  r^(x)  that 
solves 

rjx))  " Bn(l)(0,0,x,rn(x))  « 0 

for  xrx  , 

> n 

(3)  The  function  q^(x)  is  finite  and  unique  using  a similar  argument  to 
that  in  (2)  above. 

(U)  The  uniqueness  and  finiteness  together  imply  that  wn(x)  - - 

■n  T!^  " x)  defined. 

(5)  ^ . 

(a)  The  Implicit  Function  Theorem  and  the  strict  convexity  of  Bn 


imply  that 
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ry n^WnW)  + yna-2>(x,rn(,))]  < o 
[ Vn(2’  >(x,rn(:t))  + Vn(2’2,(,t>rn(l‘)):l 


In  addition,  it  follows  that  r (x  ) * w because 
’ nv  n'  n 


B (0,0,x  ,r  (x  ))  = 0 =»  B 'A;(0,0,x  ,w  ) 
n v * * n’  nv  n' ' n v * * n n' 


(D< 


and  both  r (x  ) and  w are  uniquely  defined. 
nv  n'  n ^ 


(b)  In  similar  fashion  to  (a)  it  follows  that 


J <1,2)(x,  «„(»)) 
J„(2’2)(x,  ' 


The  proof  of  Theorem  3 established  the  two  inequalities 

Jn(l’2)(x,w)  ^0 

Jn(1’2)(x,w)  + Jn(2,2)(x,w)  ^0. 

Therefore,  it  follows  that  0 < q^* (x)  ^ 1 provided  x ^ xn>  Finally, 

B ^(0,0, x ,q  (x  ))  = 0 = B ^(0,0,x  ,w  ) 
n v * ’ n*Tiv  n ' n v ’ n*  n' 

which  implies  that  q^j^)  ■ w^. 

(c)  This  part  is  obvious. 

Q.E 
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II.  It  is  assumed  that  the  demands  for  these  products  are  sequences  of  con- 
tinuous, nonnegative  and  independent  random  variables  with  known  distributions. 
Production  type  A is  used  to  produce  both  products,  but  they  are  related  as  by- 
products of  each  other  by  a fixed  set  of  production  coefficients,.  while,  type  B^J 
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.Ccx'i  •*  can  only  be  used  to  produc'e-  pfoduct  tl.  At  the  beginning,  of  each  period,  the 
• level  of  production; of  each  production  type  must  be  determined,  given  the 
amouhts  of  each  product  already  in  stock.  The  criterion  used  to  make  these 
decisions  is  based  on  the  minimum  expected  discounted  total  cost  over  the 
finite  horizon.  Results  presented  show  that  the  decision  plane  is  partitioned 
into  four  distinct  regions,  and  the  boundaries  between  these  regions  are  charac- 
terized in  terms  of  a particular  sequence  of  points  which  are  Independent  of 
the  on-hand  stock  levels  each  period. 
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